METHOD, APPARATUS AND RECORDING MEDIUM FOR IMAGE PROCESSING 

BACKGROUND OF THE INVENTION 
Field of the Invention 
5 The present invention relates to an image processing, 

method and an image processing apparatus for changing a 
color and a tone in a specific area included in a color image. 
The present invention also relates to a computer-readable 
recording medium storing a program to cause a computer to 

£3.0 execute the image processing method. 

\D 

N Description of the Related Art 

;.t 

ft? Reproduction of digital image data obtained by digital 

Q 

O still cameras (hereinafter referred to as a digital camera) 

ill 

; : and digital image data obtained by reading images recorded 

itiLs on film has been carried out to generate hard copies such 

\V 

%r ~4 as prints, or soft copies on display screens. In such 

las? 

O reproduction of digital image data, a reproduced image is 

expected to have as high a quality as a photograph printed 
from a film negative. 

20 Color reproducibility of the same person's face can 

vary between prints. Furthermore, in an image including a 
plurality of people, color reproducibility of each person's 
face can be different, depending on the intensity or 
position of a light source. In the case of an image 

25 including a person obtained by photographing, the face of 

the person attracts the most attention. In order to 
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generate a high-quality photograph, correction of the face 
so as to have an adequate skin color is necessary. To 
accomplish this, various methods of changing a skin color 
of an image to a preferable skin color, for example by using 
a display means such as a monitor and a mouse have been 
developed. One such method comprises the steps of using a 
mouse to extract pixels of skin color from an image including 
a person's face and changing the skin color value to a color 
and tone of a predefined preferable skin color value using 
the extracted color value as reference (Japanese Patent No. 
2878855, for example) . A second proposed method comprises 
the steps of specifying an area of color to be changed 
contained within a displayed image, specifying the color 
nearest to the most preferable color for the area in which 
the change is desired, upon which the color of the area is 
changed to a pre-defined color (Japanese Unexamined Patent 
Publication No.. 8 ( 1 9 9 6 ) - 2 2 1 5 4 6 ) . Furthermore, in a third 
proposed method, the areas containing human faces are 
automatically extracted and the color of the areas 
containing faces is changed to a predefined color. 

However, in all the methods described above, because 
the skin color of a human face is changed to a predetermined 
skin color, the human face does not necessarily have a 
preferable skin color after the change. Furthermore, since 
only the face color is changed, a sharp - contrast face of 
a person in an image obtained by photographing outdoors in 




sunny weather cannot be corrected. 

SUMMARY OF THE INVENTION 
The present invention has been conceived in 
consideration of the above described problems. An object 
5 of the present invention is therefore to provide an image 

processing method and an image processing apparatus which 
can change a specific area in an image such as a human face 
to a preferable color and tone (hereinafter, the color and 
tone are together referred to as the color-tone), and to 
f3Lo provide a compu t er - r eadabl e recording medium storing a 

S 1 program to cause a computer to execute the image processing 

method. 

Q An image processing method of the present invention 

31 comprises the steps of: 

1 4L 5 receiving specification of a first area having a 

py 

H desired color-tone in a displayed image; 

O 

Q receiving specification of a second area in the image 

or in another image; and 

changing a color- tone of a desired area including the 
20 second area into the color-tone of the first area. 

In the step of receiving the specification of the first 
area, not only one area but also a plurality of areas may 
be specified. * 

The "desired area including the second area" can refer 
25 to not only the entire second area, but also a specific area 

in the second area, the entire image including the second 
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area, as well as areas comprising the second area and another 
area . 

Furthermore, the specification of the first area may 
precede the specification of the second area, or vice versa. 
5 Any object can be specified as a first or second area, 

for example, a human face, the sky, or green foliage. 

An image processing apparatus of the present invention 
compri ses : 

display means for image display; 
GlO area specification means for specifying a first area 

having a desired color-tone in an image displayed on the 

^ display means and a second area in the image or in another 

Q 

y image; and 

[ ] conversion means for converting a color- tone of a 

lid: 
I 

*HL5 desired area including the second area into the color-tone 

ID 



^ of the first area. 

^ The image processing method of the present invention 

may be provided as a program stored in a computer - readable 
recording medium to cause a computer to execute the image 

20 processing method. 

According to the present invention, a first area 
having the desired color-tone in the displayed image is 
specified, and a second area in the image including the first 
area or in another image is specified. The color-tone of 

25 the desired area including the second area is converted into 

the color-tone of the first area. Thereby, the desired area 
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including the second area can be changed to have the 
color-tone desired by a user. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram showing a configuration 
of an image processing apparatus according to an embodiment 
of the present invention; 

Figure 2 shows an image displayed on a monitor; 

Figure 3 shows the image in which an area Rl has been 
specified ; 

Figure 4 is a diagram showing a skin-color range in 
a CIELAB color space; 

Figure 5 is the image in which an area R2 has been 
specified ; 

Figure 6 shows cumulative histograms; 

Figure 7 is a flow chart showing operation of the 
embodiment; and 

Figure 8 shows an image in which a plurality of faces 
have been specified as area Rl . 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

Hereinafter, an embodiment of the present invention 
will be explained with reference to the accompanying 
drawings . 

Figure 1 is a block diagram showing a configuration 
of an image processing apparatus according to the first 
embodiment of the present invention. As shown in Figure 1, 
the image processing apparatus obtains processed image data 



SI by carrying out image processing on image data S obtained 
by photographing using a digital camera, reading an image 
with a scanner, or another means. The image processing 
apparatus comprises reading means 1 for reading the image 
5 data S from a recording medium or for reading the image data 

S transferred via a network, image processing means 2 for 
carrying out the image processing on the image data S, a 
monitor 3 for displaying the image data S, and input means 
4 comprising a keyboard and a mouse for carrying out various 
OO inputs to the image processing means 2 . In this embodiment, 

HJ the case of changing a color-tone of a human face in an image 

r* 

saws 

fH is explained. 

o 

□ The image processing means 2 carries out the image 

lit 

ii processing on the image data S in the following manner. 

!1i5 First, the image data S is displayed on the monitor 3. 

in 

V J Figure 2 shows the image displayed on the monitor 3. As 

□ 

O shown in Figure 2, the image including people's faces is 

displayed on the monitor 3 . A user observes the image 
displayed on the monitor 3 and specifies the image of a face 

20 having the most preferable color- tone by using the input 

means 4. More specifically, the user specifies the image 
of a face having a desired color-tone by surrounding the 
image of the face with a rectangle by using the mouse of 
the input means 4. Figure 3 shows a state in which the image 

25 of a face having a desired color-tone has been specified. 

As shown in Figure 3, the image of a face having a desired 
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color-tone is specified by a rectangular area Rl . 



After the area Rl has been specified in the above manner, 



the image processing means 2 extracts from the area Rl an 



area Rl ' containing pixels within a predefined skin-color 



5 range. For this extraction, a skin-color range D circled 



in a CIELAB color space shown in Figure 4 is predefined and 



pixel values of the image contained in the area Rl are 



converted into the CIELAB color space. Pixels having pixel 



values within the skin-color range D are then extracted as 



(3 0 the skin-color area Rl ' . 



SI The user specifies, as an area R2 , an area including 



CO an image of a face whose color- tone is to be changed to the 

O color- tone of the image of the face in the area Rl.. This 
IV 

i\ specification is carried out in the same manner as in the 



ills specification of the rectangular area Rl . Figure 5 shows 



SJ a state in which the area R2 has been specified in addition 

B to the area Rl . After the area R2 has been specified in the 



above manner, a skin-color area R2 ' in the area R2 is 



extracted as in the case of the area Rl ' . 



20 After the skin-color areas Rl ' and R2 ' have been 



extracted, cumulative histograms of the skin-color areas 



Rl ' and R2 ' are generated. Figure 6 shows cumulative 



histograms HI and H2 of the skin-color areas Rl ' and R2 ' , 



respectively. In Figure 6, the farther the horizontal axes 



25 in the cumulative histograms HI and H2 go toward the left 



and toward the right from the origin, the larger RGB 



densities become. For cases in which the image data S 
comprises data of RGB colors, the cumulative histograms HI 
and H2 are generated for each color. For simplicity, one 
set of RGB data comprising the data of RGB colors are assumed 
5 and the cumulative histograms HI and H2 are generated from 

the RGB data. The cumulative histograms HI and H2 represent 
characteristics of the color-tone in the skin-color areas 
Rl ' and R2 ' , respectively. Hereinafter, these 

characteristics are referred to as characteristic 
i3o quantities. 

k "4 After the cumulative histograms HI and H2 are 

130 generated in the above manner, color-tone conversion 

P processing to cause the color- tone of the skin-color area 

iy 

R2 ' to become the color- tone of the skin-color area Rl 1 is 
Sl5 carried out based on the cumulative histograms HI and H2 . 

m 

'N This color- tone conversion processing is carried out by 

O relating the cumulative histogram HI with the cumulative 

histogram H2 as shown by dashed lines in Figure 6 and by 
changing the color-tone of the skin-color area R2 ' so as 
20 to cause a pixel value whose RGB density is PI in the 

cumulative histogram H2 to have an RGB density P2 . Let a 
function representing the cumulative histogram HI be g(d') 
and let a function representing the cumulative histogram 
H2 be f (d) . The processing shown by the dashed lines in 
25 Figure 6 can be expressed by Equation (1) below: 

d' = g 1 (f (d) ) (1) 



* ♦ 

If only the color- tone of the skin-color area R2 ' is 
changed, a boundary thereof looks unnatural . Therefore, it 
is preferable for the color-tone to be changed gradually 
at the boundary. 

Operation of the first embodiment will be explained 
next. Figure 7 is a flow chart showing the operation of this 
embodiment. The image data S are read and input to the image 
processing means 2 (Step SI) . The image data S input to the 
image processing means 2 are displayed on the monitor 3 (Step 
S2) . The user observes the image displayed on the monitor 
3 and specifies the area Rl including the image of a face 
having the desired color-tone. The user inputs completion 
of the specification by using the input means 4 (Step S3) . 
After the completion of the area Rl , the skin-color area 
Rl ' included in the area Rl is extracted (Step S4) . 

Meanwhile, the user specifies the area R2 including 
the image of a face whose color-tone is to be changed to 
become the same as the color- tone of the area Rl while viewing 
the image displayed on the monitor 3, and completes input 
of specification of the area R2 from the input means 4 (Step 
S5) . After completion of the specification of the area R2 , 
the skin-color area R2 ' included in the area R2 is extracted 
(step S6) . 

After the extraction of the skin-color areas Rl ' and 
R2 ' , the cumulative histograms HI and H2 of the skin-color 
areas Rl ' and R2 ' are generated (Step S7). Based on the 



cumulative histograms HI and H2 , the color-tone of the 
skin-color area R2 ' is changed to become the color- tone of 
the skin-color area Rl ' according to Equation (1) , and the 
processed image data SI are obtained (Step S8) to end the 
procedure . 

As has been described above, in this embodiment, the 
area Rl having the desired color-tone is specified and the 
color-tone of the area R2 is changed to become the color - tone 
of the face image in the area Rl . Therefore, the skin-color 
area R2 ' in the area R2 can be changed to have the color- tone 
desired by the user. 

In the above embodiment, the color- tone of only the 
skin-color area R2 ' in the area R2 is changed. However, a 
color-tone of the entire area R2 may be changed. 
Alternatively, a color-tone of a predetermined area 
including the area R2 or the entire image displayed on the 
monitor 3 (excluding the area Rl) may be changed. 

In the above embodiment, the area R2 is specified in 
the image in which the area Rl has been specified. However, 
the area R2 may be specified in an image different from the 
image having the area Rl . 

Furthermore, in the above embodiment the image of a 
face having a desired color-tone is specified as the area 
Rl . However, for cases in which there are a plurality of 
images of faces having a desired color- tone, the area Rl 
may be specified so as to include the all of said images 
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of faces. For example, in the image having people's faces 
as shown in Figure 2, if face images of three people from 
the left have a desired color-tone, the area Rl is specified 
so as to include the face images of the three people, as 
5 shown in Figure 8. Therefore, an image of a face whose 

color-tone is to be changed to the color-tone of the face 
images in the area Rl is the face image on the right, and 
this face image is specified by the area R2 . In this case, 
as in the above embodiment, a skin-color area Rl ' 
fjDO corresponding to the images of the faces of the three people 

*o 

iri the area Rl is extracted and a cumulative histogram HI 
IS is generated for the skin-color area Rl ' that has been 

O extracted. Based on the cumulative histogram HI and a 

ill 

is cumulative histogram H2 of a skin-color area R2 ' in the area 

!l5 R2 including the image of the face on the right, the 

S! color-tone of the skin-color area R2 ' is changed as in the 

O 

P embodiment described above. 

In the above embodiment, the first and second areas 
Rl and R2 are specified as the rectangular areas. However, 
20 the areas may be specified as areas having any shape. 

In the above embodiment, characteristic quantities of 
the color- tone of the skin-color areas Rl ' and R2 ' in the 
areas Rl and R2 are represented by the cumulative histograms 
HI and H2, which is not necessarily limited to these 
2 5 histograms . 

In the above embodiment, the color- tone of the image 

li 
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of a face is changed. However, an area Rl having a desired 
color-tone of the sky, green foliage or the like may be 
specified in an image so that a color-tone of another area 
R2 is changed to have the same color- tone of the area Rl . 
5 In addition, all of the contents of Japanese Patent 

Application Nos. 1 1 ( 1 9 9 9 ) - 3 6 9 3 3 8 and 2000 - 329034 are 
incorporated into this specification by reference. 
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